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ABSTRACT 

We  consider  nonlinear  constrained  optimization  problems  in  which  the 
objective  function  and  constraint  functions  are  sufficiently  smooth.  We  focus 
on  the  programs  which  consist  of  both  equality  and  inequality  constraints,  and 
we  prove  that  the  global  optimum  value  function  is  twice  continuously 
differentiable  almost  everywhere  with  respect  to  the  parameters. 
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SIGNIFICANCE  AND  EXPLANATION 


In  the  analysis  of  nonlinear  optimization  problems  which  arise  in 
engineering,  management  science  and  economic  theory,  it  is  important  not  to 
assume  that  the  relevant  objective  and  constraint  functions  are  convex.  In 
this  paper  we  give  an  analysis  of  such  problems  under  the  assumption  that 
these  functions  are  sufficiently  smooth.  We  show  that  almost  always  one  can 
expect  that  a  nonlinear  program  will  be  "well-behaved"  and  that  the  global 
optimum  value  changes  smoothly  with  changes  in  the  data. 


The  responsibility  for  the  wording  and  views  expressed  in  tms  descriptive 
summary  lies  with  MRC,  and  not  with  the  author  of  this  report. 


Morse  Programs :  A  Topological  Approach 
to  Smooth  Constrained  Optimization  II 
Okitsugu  Fujiwara 

Introduction 

In  this  paper,  we  continue  the  analysis  of  smooth  nonlinear  programming 
problems  which  we  began  in  [4].  There  we  reduced  the  nonlinear  programs  to  a 
finite  family  of  "well-behaved"  nonlinear  programs,  each  of  which  consists  of 
minimizing  a  Morse  function  on  a  manifold  with  boundary,  by  perturbing  the 
objective  function  in  a  linear  fashion  and  pertrubing  the  right  hand  side  of 
constraints  by  adding  a  constant.  We  also  gave  the  geometrical  meaning  of 
each  "well-behaved"  program. 

Here  we  consider  the  nonlinear  programs  which  consist  of  both  equality 

and  ineuallty  constraints  and,  in  particular, 

(P):  minimize  {f(x)  subject  to  g(x)  «*  b} 

lxl2<  c 

and  its  perturbation 

(P(u,v) ) :  minimize  {f(x)  -  u  x  subject  to  g(x)  *  b  +  v} 
lxl2<c 

where  f:Rn  *  R1 ,  g:R°  ♦  Rm ;  c  >  0;  u  e  Rn,  v  e  Rm  ;  n  >  m+1.  Our  main 

2 

results  are:  in  the  C  topology,  Morse  programs  are  open  and  dense  in  the 

family  of  (P),  where  f  e  C2  and  g  e  cn_m+1  (Theorem  A),  and  if  f  e  C2 

and  g  e  cn"nt4’1,  then  the  global  optimum  value  function  u>(u,v)  for 
—  2 

(P(u,v> )  is  of  class  C  with  respect  to  (u,v)  on  an  open  and  dense  set  of 
Rn  x  Rm  (Theorem  B) . 

Sponsored  by  the  United  States  Army  under  Contract  No.  DAAG29-80-C-0041.  This 
is  the  revised  version  of  Cowles  Foundation  Discussion  Paper  No.  539  (Yale 
University)  supported  in  part  by  National  Science  Foundation  Grants  ENG-78- 
25  182  and  SOC -77-03277 • 


1 .  Preliminaries  and  Notation. 

A  property  that  holds  except  on  a  subset  of  Rn  whose  Lebesgue  measure  is 
zero  is  said  to  hold  at  almost  every  u  e  Rn.  The  complement  of  a  measure 
zero  set  in  Rr  is  said  to  have  full  measure  in  Rn. 

The  Jacobian  matrix  and  the  Hessian  matrix  of  f  at  x  are  denoted  by 

Df(x)  and  D  f ( x)  respectively. 

Let  f:M  +  Rm  be  a  map  from  a  k-dimensional  manifold  M  with 

boundary  3m  in  Rn.  Let  (<j>,U)  be  a  local  parametrization  of  M  at  x 

such  that  x  =  <|>(u),  ue  U  £  H^  =  {x£  R^lx^  >  0} .  The  tangent  space  TXM 

of  M  at  x  is  defined  to  be  the  image  of  D^CuJrR^  Rn  .  A  point  x  e  M 

is  a  regular  point  of  f  if  D(fij>)  (u)  jR^  Rm  is  surjective,  otherwise  x 

is  a  critical  point  of  f  .  A  critical  point  x  of  f:M  -*■  R1  is 

2 

nondegenerate  if  the  k  x  k  matrix  D  (f<j>)(u)  is  nonsingular.  It  is  easily 
shown  that  the  above  definitions  do  not  depend  on  the  choice  of  local 
parametrization.  A  point  y  e  Rm  is  a  regular  value  of  f,  denoted  by  f  A  y , 
if  every  x  e  f  \y)  is  a  regular  point  of  f  ,  otherwise  y  is  a 
critical  value  of  f  .  f:M  ♦  R1  is  a  Morse  function  if  all  critical  points 
of  f  are  nondegenerate. 

v  Y 

Let  f:M  N  be  a  C  map,  A  £  n  be  a  C  submanifold  of  N  .  f  is 

transversal  to  A  ,  denoted  by  f  A  A  ,  if  for  ever  x  e  f  *(A),  ImageDf(x)  + 

> A  =  Tf/v >N  holds,  where  Df(x):TM  +  T.,  ,N  is  the  derivative  of  f. 
nxj  nxi  x  r(xj 

Two  submanifolds  A  ,  B  of  M  are  transversal  denoted  by  A  A  B  ,  if  i  A 
B  where  i:A  ♦  M  is  the  inclusion  map. 

The  proofs  of  the  following  theorems,  which  we  will  use  in  tnis  paper, 
can  be  found  in  Gillemin  and  Pollack  [5]. 
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(1.1) 


v  Y 

Let  f:X  ♦  Y  be  a  C1  map  such  that  f  &  Z  for  a  C  submanifold 

Z  of  Y  ,  then  f-1(Z)  is  a  CY  submanifold  of  X  and  dimf'^Z)  -  dim  X  - 

dim  Y  +  dim  Z  . 

(1.2)  Let  f:  X  ♦  V  be  a  CY  map  of  a  CY  manifold  X  with  boundary 

3X  onto  a  boundaryless  CY  manifold  Y  .  If  f  i  Z  and  flgx  A  z  for  a 

boundaryless  submanifold  Z  of  Y  ,  then  f”^(Z)  is  a  CY  submanifold  of 
X  with  boundary  3f-1(z)  -  f “ 1 { Z)  n  3X  and  dim  f_1(Z)  -  dim  X  -  dim  Y  + 
dim  Z. 

1  Y  1 

(1.3)  Let  f:  X  ♦  R  be  C  map  such  that  f  A  c  for  some  c  e  R  . 

Then  {x|f(x)  <  c}  is  a  CY  submanifold  of  X  with  boundary  f^lc)  . 

(1.4)  Let  f:X  ♦  Y  and  g:  Y  ♦  Z  be  CY  maps  .  Suppose  g  A  W  for  a 

CY  submanifold  w  of  Z  .  Then  g  #  f  l  W  if  and  only  if  f  *  g  ^ (W) • 

(1.5)  Let  X,Z  be  submanifolds  of  Y  such  that  X  A  Z.  Then  X  n  z  is 

again  a  submanifold  of  Y  ,  dim(X  n  Z)  *  dix  X  +  dim  Z  -  dim  Y  and 

Tx  (X  n  z)  *  T^  r;  txZ  for  any  x  e  X  n  z  . 

(1.6)  Let  f:X  R1  be  a  C2  map  of  a  C2  manifold  X  in  Rn.  Then  for 

almost  every  u  e  Rn,  the  function  f(x)  -  uTx  is  a  Morse  function  on  X  . 
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2.  Morse  Programs:  Definition  and  Properties. 

Let  us  consider  a  program 

(R):  minimize  {f(x)  subject  to  g(x)  <  b,  h(x)  *  c} 

and  a  perturbation 

T 

(R(u,v,w))s  minimize  (f(x)  -  u  x  subject  to  g(x)  <  b+v,  h(x)  =  c+w} 
where  f:Rn  ♦  R3,  g:Rn  ♦  Rm  and  h:Rn  ♦  R^5  are  of  class  C? ,  u  e  Rn, 
v  e  Rra,  w  £  /,  n  >  p  . 

Let  I  *  {l#»»»,m}  and  let  us  denote 

M  . :*  {x|g  (x)  *  b  »  g, (x)  <  b.  ,  h(x)  *  c} 

J  fl  J  w  1  X 

3m  **  {x|g  (x)  »  b  ,  g  (x)  *  b  ,  h(x)  *  c> 

J  g  1  J  «J  1  1 

for  all  J  £  I  and  lei.  For  notational  convenience  we  denote  M  :=  M 

J  < 

if  i  e  J,  and  X  :*  M  ,  .  ,  3X.  s*  3M  .  if  J  *  <j>  .  Note  that  if 

i  j*i  l  <J,i 

i  e  J  ,  then  M,  -  i  =  3M,  ,  .  Let  X.  :=  {x|g, (x)  4  b.}  and 

Jj,i  J,i  l  i  i 

3Xi  :=  {x|g^(x)  =  }  for  all  i  e  I  . 

Definition 

A  program  (R)  is  a  Morse  program  if  (R)  satisfies 


(Ml) 


A  b^,  h  |  if  c  and  h 


3X . 

i 


A  c  for  all  i  e  I,  and  h  A  c  . 


(M2)  g  .  A  b  and  g_.  if  b.  for  all  nonempty  J  c  x  and  i  f(  J . 

J|X  J  J|3X.  3 

l  i 

(M3)  f  is  a  Morse  function  on  h  *(c),  M  and  3m,  .  for  all 

V  f  1  J  f  1 

J  £  I  and  i  e  I 


(M4 )  f|-  has  no  critical  points  on  3M,  .  for  all  Jcl  and  i  S  J  . 

M .  j ,  1  — 

Remark  1  With  the  absence  of  equality  or  inequality  constraints,  the  above 
definition  of  a  Morse  program  coincides  with  the  one  that  I  defined  in  [4] . 


i 


i 


i 

i 
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Remark  2 


X^  (or  X^ )  is  a  manifold  with  boundary  3x^  (or  3X^)  by 

(Ml)  and  (1.2)  (or  (1.3));  and  M,  .  is  a  manifold  with  boundary  3m.  .  by 

J,i  j,i 

(M2)  and  (1.2). 

Definition  x  is  a  critical  point  of  (R)  if  x  is  a  feasible  point  of  (R) 

(i.e.  g(x)  <  b  and  h(x)  *  c)  and  x  is  a  critical  point  of  f|-  where 

MJ(x) 


J(x)  :=  {jlg^fx)  =  b_.} . 

The  following  results  are  verified  in  essentially  the  same  way  as  Theorem 
F  and  Theorem  H  in  [4]. 

Proposition  1  If  (R)  is  a  Morse  program  and  x  is  a  critical  point  of 
(R)  with  J  :=  J(x) ,  Then  we  have  that 


Dg  (x) 

(a)  (|j|+p)  x  n  matrix  (  Dh(x)  ^  has  full  rank. 

( b )  1 ^  there  exists  a  unique  ( X , n )  e  Rm  x  rP  such  that 

Df ( x)T  +  Dg(x)TA  +  Dh(x)Tu  *  0  ,  X  .  *  0  iff  i  e  J  . 

2  m  2  P  2 

(c)  .C(x)  s=  D  f(x)  +  J  A.D  q.  (x)  +  y  u,D  h.(x)  induces  an 

,  i  i  \  3  3  - 

-  2) 

isomorphism  on  TxMj 

(d)  on  ^xMj  •  JC(x)  is  positive  definite  iff  x  is  a  local 
minimum;  negative  definite  iff  x  is  a  local  maximum; 
indefinite  iff  x  is  a  saddle  point  of  f  on  . 

Proposition  2.  If  f  e  C2,  g  e  Cn  and  h  e  C°  then  for  almost  every 

fixed  (v,w)  e  Rm  x  r*3,  (R(u,v,w))  is  a  Morse  program  having  at  most  one 
global  solution  for  almost  every  u  e  R°  . 


>  0  U j  <  0)  for  all  j  £  J  if  x  is  a  local  minimum  (maximum)  (see 
Luenberger  16] .  10.6). 

2)  -  _ 

For  s  e  TxMj,  we  project  I(x)s  orthogonally  onto  TxMj  .  We  call  this 

linear  homomorphism  on  TxMj  by  Induced  homomorphism  of  jC(x)  on  TxMj  . 
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3.  Equality  Constraints  and  One  Regular  Inequality  Constraint;  Generic 
Property. 

Let  us  consider  a  program 

_  2 
(P):  minimize  {f(x)  subject  to  g(x)  =  b,  Ixl  <  c} 

and  a  perturbation  of  (P) 

(P(u,v)):  minimize  {f(x)  -  u  x  subject  to  g(x)  =  b+v,  tl xll  <  c} 

where  f:Rn  ♦  R1  and  g:Rn  Rm  are  of  class  C2  ;  u  e  Rn,  v  e  Rm  ;  c  >  0 

n  >  m+1.  Let  h(x)  :  =  (xll2,  D  :=  {x|lxl2  <  c}  and  S  :=  3D  :  = 

2 

{x|Hxll  =  c}  ,  then  h  A  c  for  all  c  >  0  i.e.  h  is  a  regular 
constraint. 

In  this  section,  we  study  a  family  of  nonlinear  programs  with  some 

equality  constraints  and  one  fixed  regular  constraint  h(x)  <  c  (c  >  0  is 

2 

fixed) .  We  will  show  that  in  C  topology  Morse  programs  are  open  and  dense 
in  this  family  (Theorem  A). 

Let  us  recall  the  definition  of  a  Morse  program. 

(P)  is  a  Morse  program  iff  (P)  satisfies 
(MP1)  glD  A  b  ,  gls  A  b 

( MP2 )  f  is  a  Morse  function  on  M  :=  g_1(b)  n  D  and 

3m  :=  g_1(b)  n  s  . 

(MP3)  f|-  has  no  critical  points  on  3M  . 

M 

Remark 

(Ml)  corresponds  to  (MP1)  since  h  A  c  .  We  do  not  have  (M2)  since 
we  have  only  one  inequality.  (M3)  corresponds  to  (MP2),  and  (M4) 


corresponds  to  (MP3) 


Firstly,  by  Proposition  2,  we  have: 

2  n-nH-1  .  ,  _ , 

Corollary  3,  If  f  e  C  and  g  e  C  ,  then  for  almost  every  fixed 

v  e  Rm,  (P(u,v))  is  a  Morse  program  with  a  unique  global  solution  for  almost 

n 

every  u  e  R  . 

Definition  Let  C2(D,Rk)  be  a  set  of  all  C2  functions  from  D  to  Rk  for 
some  k  >  1.  C2  norm  topology  «•!  on  C2(D,Rk)  is  defined  by 

#  4>  M  2  :=  max  {l$(x)l,  #D<j>(x)ll,  II  D2<}>  ( x) » }  for  $  e  C2(D,Rk)  where  »•»  is 

XED  nxk 

the  Euclidean  norm  (all  nxk  matrices  are  considered  to  be  in  R  ). 

Lemma  4.  If  glD  A  b  ,  g|g  A  b  ,  #gn  -  g#2  0  then  gn|D  A  b  , 

gn  |  s  iK  b  for  sufficiently  large  n  . 

Proof.  First  of  all  we  will  show  that  if  glD  A  b  ,  llg11  -  g>2  ♦  0  then 

gn|D  A  b  for  sufficiently  large  n  .  Suppose  it  is  not  true.  Then  there 
-1 

exists  xn  e  gn  lb)  n  D  such  that  Dgn(xn)  is  not  of  full  rank  for 
infinitely  many  n's  . 

n  . 

Since  D  is  compact,  there  exists  a  subsequence  {x  ■]}  of  {x11}  such 

that  x  "*  -*•  x°  for  some  x°  e  D  .  However  llgn  -  g#2  0  implies 

n .  n  .  Q  n .  n 

g  3(x  -1)  g(x°)  and  Dg  3(x  -1)  ♦  Dg(x  )  .  Then  g(x°)  =  b  and  since 

n  ,  n  . 

g | D  A  b  ,  Dg(x°)  is  of  full  rank.  Hence  Dg  :(x  3)  is  of  full  rank  for 
sufficiently  large  n^  which  contradicts  the  assumption.  Similarly  we  can 
show  that  (g,h)  <f>  (b,c)  and  K  gn  -  g#2  +  0  imply  (gn,h)  A  (b,c)  for 
sufficiently  large  n  •  However  by  [4]  Lemma  14(b),  we  have  (g,h)  A  (b,c) 
iff  gls  A  b  hence  we  complete  the  proof.  Q..E.D. 

Under  the  same  assumption  of  Lemma  4,  by  (1.2)  we  can  claim  that 

_  o  5  ~  ^ 

M  :=  g  (b)  n  D  is  (n-m)-dimensional  manifold  with  boundary  3m  := 

r1 

g  (b)  n  S  for  sufficiently  large  l  .  Then  we  have 

Lemma  5  If  f |  —  ,  f|  -  are  Morse  functions  and  if  llfn  -  f II  0  ,  then 
-  -  M  oM  ^ 

fni  _  .  f“i  „  are  Horse  functions  for  sufficiently  large  n  . 
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Proof 


Let  us  define  F.  :  Rn  x  Rm  Rn  x  R  and  G,  s  R  x  R  x  R 
b  o 

*  Rn  x  Rm  x  r1  by,  respectively, 

F. (x,X)  :=  (Df(x)T  +  Dg(x)TX,  g(x)  -  b)  , 

D 

and 

G.  (x,X,y)  :=  (Df{x)T  +  Dg(x)TX  +  Dh(x)Ty  ,  g(x)  -  b  ,  h(x)  -  c) . 

D 

By  the  same  argument  as  in  [4]  Theorem  B,  we  have  that 

f l-  is  a  Morse  function  iff  F,  |  AO 

i  y  - - - -  m 

DxR 

and 

f  L-.  is  a  Morse  function  iff  G,  A  0  . 

9M  E 


Let  F*(x,X)  :=  (Df^Cx)*1  +  Dg£(x)TX,  g*(x)  -  b),  then  f 1 1  is  a  Morse 
b  M* 

ft 

function  iff  F  .  AO.  Now  we  will  show  that  if  f |-  is  a  Morse 

bl  m  M 

DxR 

0  Jl 

function  and  Ilf  -  fll  ♦  0  ,  then  f  I  „  is  a  Morse  function  for 

5  £ 

sufficiently  large  £  .  Suppose,  to  the  contrary,  there  exists  {x  }  such 


ri,  £,  n  £.  £>T 

£  <x  )  Dg  (x  ) 

that  F%x*,xS  =  0  and  OF  (x  ,X  )  =  ( 

b  b  Dg*(xS  0 

where 
(3.1) 
and 


)  is  singular. 


,  £  £.  £,„  £,  £.T  -1n  £,  £.„£,  £.T 

X  :=  -(Dg  (x  )Dg  (x  )  )  Dg  (x  )Df  (x  ) 


ri,  £,  2  „£ ,  £,  ,  r  r/  ,  x\ 

•C  (x)  :=Df  (x  )  +  2,  X  D  g.  (x  )  . 


m 


l  2  ,  l, 


1 


3  3 


Since  x  e  D  and  D  is  compact,  there  exists  a  converging  subsequence  of 

o  £  *  * 

{x  }  .  For  notational  convenience,  let  x  x  for  some  x  e  D  .  Since 

ft  fl  0  * 

g  (x  )  =  b  and  #  g  -  g#2  +0  we  have  g(x  )  =  b  ,  and  since  gl^b  we 


have  that  Dg( x  )  has  full  rank. 
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so  that  we  have 


Moreover  x^  x  ,  II  -  f  II  ^  +  0  and  tl  g^  -  gll  ^  ♦  0  , 

A*'  ♦  X  :=  -(Dg(x  )Dg(x  )T)  1Dg(x  )Df(x  )T  by  (3.1).  Hence,  we  obtain 

*  *  *  • 

F,  (x  ,A  )  =  0  and  because  f|-  is  a  Morse  function,  DF.  (x  ,A  )  is 

D  M  D 

z  z  z  *  *  z  z  z 

nonsingular.  However  we  have  DF^(x  ,A  )  +  DFfa(x  A  )  •  Hence  DFfa(x  ) 
is  nonsingular  for  sufficiently  large  Z  and  this  contradicts  the  choice  of 


{x*} .  By  a  similar  argument,  we  prove  that  if  f | ^ —  is  a  Morse  function  and 
Z  Z 

if  Ilf  -  fl  ♦  0  ,  then  f  |  is  a  Morse  function  for  sufficiently  large 

2  3m* 


Z  . 


Q  .E .  D. 


Lemma  6.  Under  the  same  assumptions  of  Lemma  5,  if  f|-  has  no  critical 

point  on  3m  then  fn|  has  no  critical  point  on  3Mn  for  sufficiently 

Mn 

large  n. 

Proof .  Suppose  it  is  not  true,  then  there  exists  x11  e  3Mn  such  that  xn  is 

a  critical  point  of  fn|  for  infinitely  many  n's.  Then  there  exists  a 

Mn 

unique  A  e  R  such  that 

n  n.  T  „  n,  n.T.n 
Df  (x  )  +  Dg  (x  )  A  =  0  . 

n  . 

Since  D  is  compact,  there  exists  a  subsequence  {x  of  {x  }  such  that 

n .  o  q  n  n 

x  3  +  x  for  some  x  e  D  .  Since  Ilf  -  f II 2  0  ,  II g  -  gll^  ♦  0  and 

II xn M  =  c,  we  have  U x° H  =  c  ,  g(x°)  =  b  and  Df(x°)T  +  Dg(x°)TA°  =  0 

where  A  :=  A(x°)  (see  (3.1)).  This  shows  x°  e  3M  is  a  critical  point  of 

f|-  which  contradicts  our  assumption.  Q.E.O. 

M 

Combining  Corollary  3,  Lemmas  4,5,6  we  obtain 
Theorem  A 

9 

In  the  c  topology,  Morse  programs  are  open  and  dense  in  the  family  of 
programs 

minimize  {f(x)  subject  to  g(x)  =  b} 

II  xll  2<c 

where  f:Rn  +  r\  g:Rn  Rm;  f  e  C2,  g  e  C°  n  >  m+1  . 
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* 


4.  Equality  Constraints  and  One  Regular  Constraint;  Sensitivity  Analysis 

Now  we  will  discuss  the  global  optimum  value  function 

w(u,v)  :=  minimum  {f(x)  -  u  x  subject  to  g(x)  =  b  +  v} 
llxli2<c 

for  (P(u,v)).  The  basic  ideas  are  essentailly  the  same  as  those  in  Theorem  E 

of  Fujiwara  [4],  where  1  discussed  the  optimum  value  function 

T 

w(u,v)  :=  minimum  {f(x)  -  u  x  subject  to  g(x)  =  b  +  u} 
xeRn 

and  I  assumed  g  :  Rn  Rm  is  proper  (i.e.  if  txH  ♦  “>,  then  lg(x)l  “). 

Here  we  do  not  assume  that  g  is  a  proper  function,  and  the  argument  is  more 
delicate. 

First,  let  us  denote 

Z  :=  { (u,v)  e  Rn  x  Rm|(P(u,v))  is  a  Morse  program} 


and 


Z  ’  :=  { ( u , v )  G 


Rn  x  Rm.(P(u,v))  is  a  Morse  program  i 
with  a  unique  global  solution  * 


Lemma  7  Z  is  an  open  set  of  Rn  x  Rm. 

Proof.  Suppose  Z  is  not  open  at  (u,v)  e  Z  .  Then  there  exists  a  sequence 

{(u  ,v  )}  such  that  (u  ,v  )  -►  (u,v)  and  (P(u  ,v  ))  does  not  satisfy 

—  £  £ 

(MP1)  or  (MP2)  or  (MP3).  Suppose  (P(u  ,v  ))  does  not  satisfy  (MPl) 

T 

—  —  rjt  Z 

infinitely  often.  Let  f(x)  =  f(x)  -  u  x,  f  (x)  =  f(x)  -  u  x  ; 

-  —  — £  £  ££__ 

g(x)  =  g(x)  -  v,  g  (x)  =  g(x)  -  v  .  Then  (u  ,v  )  +  (u,v)  implies 

—  £  —  — £  —  _  £  £ 

Ilf  -  f fl 2  "*■  0  and  II  g  -  gll  ♦  0  .  Hence,  by  Lemma  4  ,  (P(u  ,v  )) 

satisfies  (MPl)  for  sufficiently  large  i  and  this  contradicts  the 

-  I  l 

assumption.  Similarly  if  (P(u  ,v  ))  does  not  satisfy  ( MP2 )  (or  (MP3)),  then 


by  Lemma  5  (or  Lemma  6)  we  have  a  contradiction.  Therefore  Z  is  an  open  set 
of  R  x  r  .  Q . E . D • 
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Proposition  8.  The  number  of  critical  points  of  (P(u,v))  is  finite  for 
any  (u,v)  e  Z  ,  and  it  is  locally  constant  on  the  open  set  Z  . 

Proof . 

Let  us  define  F  :Rn  x  Rm  x  Rn  x  Rm  ■+■  Rn  x  Rm  and  G  :  R°  x  Rm  x 

1  „n  nt  n  _m  1 
RxRXR+RxRxR  by 

*  T  T 

F(x,X,u,v)  :=  (Df(x)  -  u  +  Dg(x)  X  ,  g(x)  -  b  -  v) 


and 


G(x,X,v,u,v)  :=  (Df(x)T  -  u  +  Dg(x)TX  +  Dh(x)Tv  ,  g(x)  -  b  -  v,  h(x)  -  c). 


Let  (u,v)  e  Z  and  let  M  :=  g  \b  +  v)  n  D  and  3m  :=  g  ^(b  +  v)  n 

S.  Then  x  is  a  critical  point  of  (P(u,v))  if  and  only  if  x  is  a 

T  T 

critical  point  of  either  f(x)  -  u  x|-  or  f(x)  -  u  x | ^ —  .  By  (MP3),  we  have 
that  no  critical  points  of  f(x)  -  uTx|-  are  on  3M.  Therefore,  x  is  a 
critical  point  of  (P(u,v))  if  and  only  if  x  satisfies  either 
(4.1)  F(x,X,u,v)  =  0  for  some  X  e  Rm  and  h(x)  <  c 


or 


(4.2) 


G(x,X,v,u,v)  =  0  for  some  X  e  R  and  v  >  0. 
-T 


By  (MP2)  f(x)  -  u  x  is  a  Morse  function  on  M  and  on  3M  ,  hence  critical 
points  of  f(x)  -  u  x|-  and  critical  points  of  f(x)  -  u  x|g-  are 

isolated.  Since  M  and  3m  are  compact,  the  number  of  critical  points  of 

-  -  -  - 1  -k 

(P(u,v))  is  finite.  Let  x  ,***,x  be  distinct  critical  points  of 

— T  -fc+ 1  ~k+£ 

f ( x )  -  u  x|-  and  let  x  ,»**,x  be  distinct  critical  points  of 

M 

-T  ,  ,  r“1  -k,  r-k+1  -k+fc-.  , 

f ( x )  -  u  xL-  .  Then  we  have  that  tx  ,***,x  )  n  (x  ,*»»,x  )  =  $  and 

a  M 

-  -  -  -1  -k 

the  number  of  critical  points  of  (P(u,v))  is  k+i  .  Let  X  ,***X  be  the 

....  ^  -1  -k  rk+ 1  -k+ 1 , 

associated  Lagrange  multipliers  of  x  ,,,,x  .  Let  (X  ,v  ),*••, 

-k+l  -k+i  ,  ,  ,  ,  ,  -k+1  -k+£ 

(X  ,v  )  be  the  associated  Lagrange  multipliers  of  x  ,»**,x 
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By  (MP2)  we  have  that  F  -  |  AO  and  G  -  -  |  .A 

.  (U'V)  DXR*  A  (U'V)  SXRmxR1 

0,  where  F.  .(x,X)  =  F(x,X,u,v)  and  G  (x,X,v)  =  G(x,X,v,u,v)  (see 

\  U*  V )  l  U/  V J 

the  beginning  of  the  proof  of  Lemma  5).  In  particular,  therefore  we  have  that 

DF  -  -  (x  /X1)  and  DG  -  -,(x3,X3,v3)  are  nonsingular  for  i  =  1,**»,k  and 
(u,v)  (u,v) 

for  j  =  lct-1  ,•••  ,k+£ .  Hence,  by  the  implicit  function  theorem  (Edwards  [1]  , 
p.  417 ) ,  there  exist  neighborhoods  U1(u),vi(v),  xNx1),  A1  (X1 ) ,  and  C1 
functions  xi(*,*)  and  Xa{*,*)  from  U1  x  v1  to,  respectively, 

X1  and  A1  such  that  x'*'(u,v)  =  x^  ,  X^(u,v)  =  X^ 


(4.3) 


X1  C  D  -  S  , 


(4.4)  F(x,X  ,u,v)  =  0  <*>  x  =  x1(u,v),  X  =  XX(u,v)  on  X*  x  A1  x  u*  x  Vi 
for  i  =  1,**»,k;  and  there  exist  neighborhoods  u3(u),  V3(v),  X3(x3)  ,A3(X 3) , 
N3  (v3 )  and  C1  functions  x3(»,»)»  X3 (*,*)»  V3(»,»)  from  U3  x  V3  to, 
respectively,  X3,  A3,  N3  such  that  x3(u,v)  =  x3,  X3(u,v)  *  X3,  v3(u,v)  =  v3 


(4.5)  G(x,X ,V,u,v)  =  0  <=*«>  (x,X,v)  =  (x3(u,v),  X3(u,v),  v3(u,v)) 

on  X3  x  A3  x  N3  x  U3  x  v3 
for  j  =  k+1 , • • • ,k+£  . 

Since  z  is  open  (Lemma  7),  we  can  choose  U(u)  and  V(v)  such  that 
k+£  _  k+£ 

U  £  fi  5  ,  V  £  n  V1  ,  and  U  x  v  £  5  ,  and  such  that  x^tUjV),***, 
i=1  i=1 

k+Jl  -  - 

x  (U,V)  are  pairwise  disjoint.  Now  (4.1)  -  (4.5)  imply  that  the  number  of 

critical  points  of  (P(u,v))  is  no  less  that  k  +  £  for  (u,v) 

-  1 

e  u  x  v,  because  x  (u,v),  •••,*.  (u,v)  are  distinct  critical  points  of 

(P(u,v) )  for  (u,v)  e  U  x  v  .  We  claim  that,  in  actual  fact,  it  is  exactly 


k  +  i.  Suppose,  to  the  contrary,  there  exists  {(u  ,v  )}  such  that 
(u  ,v  )  e  u  x  v,  (u^.v01)  ♦  (u,v)  and  the  number  of  critical  points  of 
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(5(u°,va))  is  greater  than  k  +  £.  Firstly,  assume  that  there  exist 
infinitely  many  {(xa,Aa)}  such  that  x0  t  {x1 (ua, va) ,• • • ,xk(ua, va)} , 

F(  x01 ,1°  ,ua ,  va )  =  0,  and  h(xa)  <  c  .  Since  {x“}  cm  and  M  is  compact, 

there  exists  a  converging  subsequence  of  {xa}.  For  notational  convenience, 

*  *  — 

let  us  denote  x  -*•  x  for  some  x  EM.  Since 

Aa  :=  A(x°)  :=  (Dg(xa)Dg(x°)T)  ^gCx01)  (Df (xa)T  -  u°) 

a—  a**  a  q  (i  d 

and  u  ♦  u  ,  we  obtain  X  X  :=  X(x  )  .  Then  we  have  (x  ,A  ,u  ,v  ) 

f  A  A  *  *  « 

(x  ,A  ,u,v),  hence  by  the  continuity  of  F  ,  F(x  ,A  ,u,v)  ■«  0. 

Note  that  h(x*)  <  c,  because  if  h(x*)  =  c  ,  then  we  obtain 

*  ★  *  «  _  * 

G(x  ,A  ,0,u,v)  =  0  and  this  implies  that  x  is  a  critical  point  of 

f(x)  -  uTxL-  with  v  =  0  ,  which  contradicts  the  fact  that  (u,v)  e  Z  . 
oM 

*  ^iji  *  * 

Therefore  x  is  a  critical  point  of  f(x)  -  u  x|-  ,  and  hence  (x  ,A  ) 

■  (x1,!*)  for  some  i  »  1,«»«,k.  But  this  contradicts  (4.4),  because  then 
for  sufficiently  large  a  ,  we  have  that 

(xa,Aa,u“,v°)  e  XA  x  A1  x  D1  x  V1 


a  ,a  a  a,  n 
F(x  ,A  ,u  ,v  )  =  0 


and  x 


a  .  ,  1 ,  a  a.  k,  a  a., 

St  lx  (u  ,v  ),•••, x  (u  ,v  ))  . 


k,  a  a. 


Similarly  if  we  assume  that  there  exist  infinitely  many  { (xa,Aa,va)} 
such  that  xa  i  {xk+1(ua,va) ,••• ,xk+*(ua,va)}  and  G(x“, Aa,va,ua,v°)  *  0, 
then  we  can  arrive  at  a  contradiction.  Hence,  the  number  of  critical  points 


of  (P(u,v) )  is  k+£  in  a  small  neighborhood  of  (u,v). 
Corollary  9.  Z*  is  an  open  set  of  R°  x  Rm. 


Qe  E* D* 


If  f  e  c  and  g  e  C  ,  then  by  Corollary  3,  Z  and  Z  are  dense 


sets  of  Rn  x  Rm,  hence  we  obtain 
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Theorem  B.  If  f  e  C2  and  g  e  Cn  ^ 1 ,  then  the  global  optimum  value 

function  u(u,v)  for  (P(u,v))  is  of  claee  C2  with  reepect  to  (u,v)  on 

—  j  n  d 

the  open  and  dense  set  Z  of  R  x  r  . 

Proof.  Using  the  same  notation  as  in  Proposition  8,  we  have 

•  •  .  ^  .  .IJ  ^  . 

u>(u,v)  ■  min  {f(x  (u,v))  -  u  x  (u,v)}  . 

1<i<K+i 

-  -  -  i--  -t  i  -  - 

Hence  w(u,v)  *  f(x  (u,v))  -  u  x  (u,v)  for  some  i  .  It  is  easily  shown 
(see,  for  example,  Luenberger  [6],  10.5),  that 

Du(u,v)  *  -  (xi(u,v),  Xi(u,v)) 

and 

2 _  Dxi(u,v) 

D  (U  (u,  v)  *  -  (  . _ )  . 

DX  <u,v) 

Therefore  o>  is  in  C2  .  The  rest  of  the  proof  is  derived  by  Lemma  7, 
Proposition  8,  and  Corollary  9.  q.E.D. 

Remark 

The  differentiability  of  the  local  optimum  value  function  was  given  by 
Fiacco/McCormick  [2]  and  Fiacco  [3] ,  using  the  implicit  function  theorem.  Our 
result  presented  here  is  not  for  the  local,  but  the  global  optimum  value 
function.  (See  also  [4]  Proposition  6,  and  Theorem  E). 
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5.  Fixed  and  Variable  Constraints 


As  a  natural  extension  of  Section  3,  we  consider  a  smooth  nonlinear 
program  defined  by  a  set  of  variable  constraints  (which  we  are  allowed  to 
perturb)  and  fixed  constraints  (which  we  are  not  allowed  to  perturb).  Namely 
we  consider  a  program 

(S )  s  minimize  {f(x)  subject  to  g(x)  4  b,  h(x)  -  c) 

G(  x  )<0 
H(x)-0 

and  a  perturbation  of  (S) 

T 

(S(u,v,w)):  minimize  {f(x)  -  u  x  subject  to  g(x)  4  b+v,  h(x)  ■  c+w} 

GlxXO 

H(x)-0 

where  f,g,h,G,H  are  of  class  C2  from  Rn  respectively  to  R1,  R rP,  Rr, 

s  „n  _w  „p 

Rj  u  E  R  ,  v  e  R  ,  w  E  Rr  . 

We  impose  a  condition  ( cO )  to  G  and  H 

(cO)  (G  ,H)  (0  ,0)  for  every  a  c  { i ,  2,  •  •  •  ,r} . 

a  a  "" 

For  example,  if  we  take  Gk(x)  -  -x^  for  k  «  1,  •••,n,  then  G  satisfies 
( cO ) ,  and  (S;  becomes 

minimize  {f(x)  subject  to  g(xj  4  b,  h(x)  ■  c} . 
x  >  0 

Moreover,  if  G  e  Cn,  H  e  C°  8+1 ,  then  we  can  assume  that,  generically, 

( cO )  is  satisfied  (cf.  [4],  Lemma  11). 

Spingarn  (  ( 7 ] , [ 8 j , [9]  )  considered  a  more  general  fixed  constraint  set, 
named  "cyrtohedron"  which  contains  degenerate  points  and  he  showed  that  the 
problem  is  reduced  to  solving  at  most  a  countable  number  of  programs  of  type 
(S)  ([9],  (3.7)).  In  our  framework,  we  consider  a  program  (S'  and  we  impose 
the  condition  ( cO )  on  G  and  H  so  that  we  do  not  have  degenerate 
points.  The  basic  idea  is  the  same  as  that  shown  in  [4]  Theorem  H;  namely,  we 
perturb  the  right  hand  side  so  that  the  feasible  region  becomes  a  union  of  a 
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finite  family  of  manifolds  with  boundary*  We  then  perturb  the  objective 


function  so  that  it  becomes  a  Morse  function  on  each  manifold  and  it  has  no 
critical  points  on  the  boundary  (hence  strict  complementarity  holds)*  Then, 
we  derive  the  necessary  conditions  for  the  optimality  of  this  type  of  problem, 
which  is  a  special  case  of  Spingarn  ([9], (3.9)). 

Let  N  :■  {x|G  (x)  -  0,  H(x)  -  0}  for  a  c  {l,***,r},  then  N  is  a 
a  a  ~  a 

manifold  of  dimension  n-|a|-s  by(cO)  and  (1.1).  Let  us  consider  all 
(b,c)  e  Rm  x  rp  that  satisfy  the  following  conditions  (c1)-(c3); 

(cl):  (9j»h)  *  (bj,c)  for  all  J  c  {l,»**,m} 

(c2) : 


( c3  ) 


(g,,h) I  a  (b_,c)  for  all  J  and  a  . 
J  N  J 

a 

g  J  *  b  for  all  J,  a,  and  i  i  J, 

1  M,nN  1 
J  a 


where  M  :■  {x|g_(x)  *■  b  ,  h(x)  *  c}  . 

J  J  J 

Note  that  if  g  e  Cn ,  h  e  c”  P+1  then  the  set  of  all  (b,c)  satisfying 
(cl)  -  (c3)  has  full  measure  in  Rm  x  RP  by  Sard's  theorem  and  Fubini’s 
theorem  (cf.  [4],  Lemma  11).  By  (cl)  and  (1.1),  M  is  (n-|j|-p)- 

U 

dimensional  manifold  for  all  J  ;  by  (c2),  (1.1),  (1.4),  and  (1.5),  n  N 

J  a 

is  (n  -  |J|  -  p  -  I  a ]  -  s)-dimensional  manifold;  by  (c3)  and  (1.2), 

M,  n  N  ng.  (-*»,b.  ]  is  (n  -  |J|  -  p  -  |a|  -  s)  -dimensional  manifold  with 
J  a  1  1 

boundary  M  n  N  n  g.'lb  ).  Then  by  (1.6),  for  almost  every  u  e  Rn, 

J  (X  11 

T 

f(x)  -  u  x|-  is  a  Morse  function  for  all  J  and  a  .  By  [4] 

M  _  ON 

J  a 

n  T 

Proposition  13,  for  almost  every  ueR,f(x)-ux|-  „  -1,  ,  ,  has  no 

_  _  Mjr,Vgi  (_O0'bi] 

critical  points  on  M  n  N  n  g  (b.)  for  all  J,  a,  and  i  ^  J  . 

J  01  11 

Now,  let  us  fix  u  e  Rn  and  (b  +  v,  c  +  w)  e  Rm  x  rP  satisfying  the 

*  n 

above  conditions.  Let  x  e  R  be  a  feasible  point  of  (S(u,v,w))  and  a 

T  * 

critical  point  of  f(x)  -  u  x|-.  ,  where  J  »  { i | g  (x  )  ■  b.  +  v,}, 

n 1  11 

#  _  J  « 

a  »  (k|G.(x  )  -  0}  and  M*  *  (x|g  (x)  -  b  +  v  ,  h(x)  -  c  +  w} .  Then  by 
K  J  J  J  J 


( c2 ) /  (1.1),  (1.4)  and  (1.5),  we  have  T  ,(M*  n  N  )  -  T  n  T  and 

X  XX 


*  *  «  « 

T  (M*  n  N  )  =  Ker  Dg  (x  )  n  Ker  Dh(x  )  n  Ker  DG  (x  )  n  Ker  DH(x  ). 
* '  .7  ft  J  ® 


*  *'"j  "  "a  - a 

x  *  m  *  _p  *  r  , 

Hence,  by  [4]  Lemma  1,  there  exist  unique  X  e  R  ,  u  e  R^ ,  £  e  R  and 

♦  s 

n  e  R  ,  such  that  * 

Df(x  )T  -  u  +  Dg(x  )TX  +  Dh(x  )^U  m  _(DG(x  )  K  +  DH(x  )  7)  )  €  T  , 

x 

*  -  ».  5*c  -  0 

J  a 

where  JC  -  {1,  ...,m}  -  J  and  a°  -  { 1 , • *  *  ,r}  -  a  .  Moreover,  using  the  same 
argument  as  that  of  the  proof  of  [4]  Theorem  G,  we  have 

X*  *  0  iff  i  e  J  . 

i 

Hence,  we  obtain  a  special  case  of  Spingam  ([9], (3. 9)), 

Proposition  10 

Suppose  g  e  Cn  and  h  eCn_P+1.  Then  for  almost  every  fixed  (v,w)  e 
Rm  x  R15,  (S (u, v, w) )  has  the  following  properties  for  almost  every  u  e  R°. 

If  x  is  a  feasible  point  of  (S(u,v,w))  and  a  critical  point  of  f(x)  - 
uTx  on  M’_  n  N  where  J  *  (i|g,(x)  »  b,  +  v.},  a  »  {k|Gv(x)  -0}, 

■  J  Q  1  *  *  ^ 

M*  ■  g  1  (b  +  v)  nh  ^  ( c  +  w),  N  “  G  (0  )  n  R  (0),  then 

J  \J  01  01  01 

(a)  (Dga(x)T,  Dh(x)T,  DGo(x)T,  DH(x)T)  has  full  rank. 

(b)  there  exist  unique  X  6  Rn,  p  £  rP»  5  e  R  »  n  e  R  such  that 
Df(x)T  -  u  +  Dg(x)T  X  +  Dh(x)TU  -  -(DG(x)T£  +  DH(x)Tn)  e  T^j 

*  °  iff  i  e  J;  ?k  -  0  for  k  i  a  . 

(c)  -C(x)  *  D2f(x)  +  l  X  D2g  (x)  +  l  p.D2h  (x)  +  l  K  g2G  £x) 

i  j  J  k 


+  l  n.D2Hs(x)  induces  an  isomorphism  on  T  (M^  n  Na> . 
l 
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minimum;  negative  definite  if  x  is  a  local  maximum,  indefinite 


iff  x  is  a  saddle  point  on  Mj  n  . 
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